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REDUCING HALO-LIKE EFFECTS IN MOTION- COMPENSATED INTERPOLATION 

Commissioner for Patents 
P.O. Box 1450 

Alexandria, VA 22313-1450 
Sir: 

APPEAL BRIEF 

This is an appeal from the Examiner of Group 2613 finally 
rejecting claims 1, 4, 6 and 7 in this application. 



(i) Real Party in Interest 

The real party in interest in this application is KONINKLIJKE 
PHILIPS ELECTRONICS N.V. by virtue of an assignment from the 
inventors recorded on June 11, 2002, at Reel 12989, Frames 636-638.. 



(ii) Related Appeals and Interferences 

There are no other appeals and/or interferences related to 
this application. 
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(iii) Status of the Claims 

Claims 1, 4, 6 and 7 stand finally rejected. Claims 2, 3 and 5 
have been allowed. 

(iv) Status of Amendments 

There was one (1) Amendment filed on July 13, 2005, after 
final rejection on May 20, 2005, this Amendment having been entered 
by the Examiner. 

(v) Summary Of Claimed Subject Matter 

The subject invention relates to mot ion- compensated 
interpolation of an image signal containing successive images, each 
image having groups of pixels. Motion vectors are generated between 
groups of pixels in one image and corresponding groups of pixels in 
a successive image, and interpolated results are obtained as a 
function of the motion vectors, an interpolated image being 
obtained by averaging the interpolated results, this interpolated 
image being temporally located between the successive images. 

Appellants have found that when using this method, the area of 
halo-effect in the interpolated image is increased, wherein the 
halo-effect is due to impairments (blurring and/or magnifying lens 
effect) mainly occurring at the boundaries of moving objects, due 
to incorrect motion vectors and/or an incorrect interpolation 
strategy in the motion compensated interpolated images. 
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The subject invention seeks to reduce the area of halo-effect 
in interpolated images. To that end, as claimed in claims 1 and 6, 
the subject invention includes ''generating motion vectors, each 
motion vector corresponding to a group of pixels of one image, 
between a group of pixels of said one image and a second group of 
pixels of another image in the data-signal". This is shown in Fig. 
3 and described in the specification on page 8, line 32 to page 9, 
line 2, in which in block 18, a first motion vector is calculated 
for each group of pixels while a number of second motion vectors of 
surrounding groups of pixels are assigned to each group of pixels. 
Next, as claimed in claims 1 and 6, the subject invention includes 
''generating interpolated results as a function of these motion 
vectors". This is shown in Fig. 3 and described in the 
specification on page 8, lines 30-31, and on page 6, line 23 to 
page 7, line 14, in which block 16 receives the motion vectors from 
block 18 (via blocks 20. m) and the corresponding pixels from the 
input data- signal, and calculates the interpolated results. The 
subject invention further includes "estimating the reliability of 
each motion vector corresponding to a particular group of pixels" . 
This is shown in Fig. 3, and described in the specification on page 
9, lines 2-4, in which blocks 20. m calculate the reliability of 
each of the motion vectors. Now, according to claims 1 and 6, the 
subject invention includes "calculating weights as a function of 
the reliability of the motion vectors" . As noted in the 
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specification on 2, lines 12-15, and on page 7, lines 16-18, a 
relative weight corresponding to each interpolation result is 
calculated on the basis of the reliability of the motion vector, 
this calculation be carried out in block 16. Finally, the invention 
includes ''generating an interpolated luminous intensity of a group 
of pixels for an interpolated image by calculating, on the basis of 
these weights, a weighted average of the interpolated results". 
This is described in the specification on page 2, lines 16-31, page 
7, lines 18-23, and page 8, lines 31-32, in which block 16 also 
calculates the interpolated luminous intensities. 

Claim 4 indicates "the generation of interpolated luminous 
intensities is only performed in those parts of the images of the 
data- signal where edges in the motion vector field of the images 
are located''. This is described in the specification on page 8, 
lines 1-6. 

(vi) Grounds of Rejection to be Reviewed on Appeal 

Whether the invention, as claimed in claims 1, 4, 6 and 7, is 
anticipated, under 35 U.S.C. 102(b), by U.S. Patent 5,412,435 to 
Naka j ima . 

(vii) Arguments 

The Naka j ima patent discloses interlaced video signal motion 
compensation prediction system in which motion vectors are 
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generated for selected groups of pixels in one image and 
corresponding groups of pixels in a second image. These motion 
vectors are applied to a selector 43 which selects one of the 
motion vectors in response to a comparison by a comparator 42 . 

The subject invention, as claimed, includes ''generating motion 
vectors, each motion vector corresponding to a group of pixels of 
one image, between a group of pixels of said one image and a second 
group of pixels of another image in the data-signal", ''generating 
interpolated results as a function of these motion vectors", 
"estimating the reliability of each motion vector corresponding to 
a particular group of pixels", "calculating weights as a function 
of the reliability of the motion vectors", and "generating an 
interpolated luminous intensity of a group of pixels for an 
interpolated image by calculating, on the basis of these weights, a 
weighted average of the interpolated results" . 

As noted in MPEP 2131, "A claim is anticipated only if each 
and every element as set forth in the claim is found, either 
expressly or inherently described, in a single prior art 
reference." Verdegaal Bros. v. Union Oil Co. of California, 814 
F.2d 628, 631, 2 USPQ2d 1051, 1053 (Fed. Cir. 1987) . Further, "The 
identical invention must be shown in as complete detail as is 
contained in the ... claim." Richardson v. Suzuki Motor Co., 868 
F.2d 1226, 1236, 9 USPQ2d 1913, 1920 (Fed. Cir. 1989). 
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Appellants submit that while Nakajima arguably discloses 
generating motion vectors, and estimating the reliability of each 
motion vector (note that the motion vectors from the motion vector 
estimators 31-3n include prediction error signals El-En) , Nakajima 
neither discloses or suggests "calculating weights as a function of 
the reliability of the motion vectors", "generating interpolated 
results as a function of these motion vectors" , and "generating an 
interpolated luminous intensity of a group of pixels for an 
interpolated image by calculating, on the basis of these weights, a 
weighted average of the interpolated results" . 

With regard to the limitation "calculating weights as a 
function of the reliability of the motion vectors", in Nakajima, 
the reliability of the motion vectors VI ... Vn are the prediction 
error signals El ... En. According to Nakajima at col. 11, lines 
21-24, these prediction error signals El ... En are given handicap 
values (weighted) corresponding to the number of vectors according 
to coded information CI. Hence, the weighting in Nakajima is not a 
function of the reliability of the motion vectors, but rather 
corresponds to a number of vectors. 

The Examiner states : 

"In fig. 20, Nakajima discloses the inputted motion 
vectors VI ... Vn to element 43, the selection, is done 
to process or interpolate the results of the motion 
vectors VI ... Vn obtained via the motion vector 
estimators 31 ... 3n. Finally, at the end of the 
process or interpolation, whereby element 43 considers 
the information from elements 41 and 42 that 
incorporates the data of the weights El ... En, the 
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best processed or interpolated results are outputted 
from element 43. Thus, Nakajima discloses ''generating 
interpolated results as a function of these motion 
vectors" . 

However, according to Nakajima at col. 11, lines 2-10, the 

values VI ... Vn are motion vectors, while El ... En are block 

prediction errors. At col. 11, lines 19-29, Nakajima states: 

''Prediction errors El, E2 . . . , En output from the 1- 
, 2-, . - . , n-vector motion estimators 31, 32 ... , 
3n are input to a pre -processor 41, and the individual 
prediction errors are given handicap values 
corresponding to the number of vectors according to 
coded information CI. The signals given the handicap 
values are compared in a comparator 42 for selection of 
one of them for each block, and a selection flag ZM 
indicative of the selected signal is output. According 
to the result obtained in the comparator 42, a selector 
43 effects motion vector selection to output motion 
vector ZV." 

It should be clear from this passage that the block prediction 
errors El ... En are weighted (given handicap values) in the pre- 
processor 41, and the weighted block prediction errors are then 
compared in the comparator 42 for selecting one of the block 
prediction errors El ... En. The selected block prediction error is 
then applied to the selector 43 to select the output motion vector 
ZV from the applied motion vectors VI ... Vn. Hence, contrary to 
the Examiner's statements, there is no interpolation. Rather, there 
is a selection of one of the block prediction errors El ... En and 
the selection of one of the motion vectors VI ... Vn based on the 
selected block prediction error. 

The Examiner then states: 
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''Also in Nakajima's fig. 20, the results that are 
outputted from element 43, clearly are obtained by 
incorporating the weights El ... En, i.e., luminous 
intensity, from elements 31 ... 3n. The weights El ... 
En are inputted to elements 41 and 42 where the data is 
processed or interpolated to generate interpolated data 
to send to element 43 that takes the weighted data El 
... En into consideration, and that element 43 yields 
the best processed or interpolated results for the 
generation of interpolated luminous intensity, ie. 
Weighted data, of a group of pixels for an interpolated 
image. Weighted data El ... En are obtained from 
interpolated luminous intensity or the luminance 
differences to determine the differences in motion in 
order to properly determine the best representative 
luminous intensity of the image data. Thus, Nakajima 
teaches ''generating an interpolated image by 
calculating, on the basis of these weights, a weighted 
average of the interpolated results" . 

This statement of the Examiner is incredible, especially when 
compared to that which is specifically stated in Nakajima (above) . 
Appellants submit that the sole intent of Nakajima is to generate 
motion vectors with the smallest prediction errors. 

Nakajima mentions interpolation in describing the inter- field 
interpolated motion estimator 14 (Figs. 4, 13), intra-field 
interpolation circuit 22 (Figs. 7, 9, 11, 16), intra-frame 
interpolation circuit 28 (Fig. 14) . However, in each case, these 
circuits receive the input and reference block data (10 and 11) , 
and are used to generate motion vectors. This is just the opposite 
from the subject invention as claimed, to wit, "generating 
interpolated results as a function of these motion vectors" and 
"generating an interpolated luminous intensity of a group of pixels 
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for an interpolated image by calculating, on the basis of these 
weights, a weighted average of the interpolated results". 

Based on the above arguments, Appellants believe that the 
subject invention is neither anticipated nor rendered obvious by 
the prior art and is patentable thereover. Therefore, Appellants 
respectfully request that this Board reverse the decision of the 
Examiner and allow this application to pass on to issue. 



It is hereby certified that this correspondence is being 
deposited with the United States Postal Service as first-class mail 
in an envelope addressed to: 



Respectfully submitted. 



Edward W . Goodman^ Reg . 28,613 
Attorney 




CERTIFICATE OF MAILING 



COMMISSIONER OF PATENTS AND TRADEMARKS 
P.O. BOX 1450 
ALEXANDRIA, VA 22313-1450 
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(viii) Appendix 



CLAIMS ON APPEAL 

1. (Previously Presented) A method of mot ion- compensated 
interpolation of a data-signal, said data-signal comprising 
successive images wherein each image comprises groups of pixels , 
the method comprising the steps of: 

5 generating motion vectors, each motion vector 

corresponding to a group of pixels of one image, between a group of 
pixels of said one image and a second group of pixels of another 
image in the data-signal; 

generating interpolated results as a function of these 
10 motion vectors; 

estimating the reliability of each motion vector 
corresponding to a particular group of pixels; 

calculating weights as a function of the reliability of 
the motion vectors; and 
15 generating an interpolated luminous intensity of a group 

of pixels for an interpolated image by calculating, on the basis of 
these weights, a weighted average of the interpolated results. 

2. (Previously Presented) A method of motion- compensated 
interpolation of a data-signal, said data-signal comprising 
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successive images wherein each image comprises groups of pixels, 
the method comprising the steps of: 
5 generating motion vectors, each motion vector 

corresponding to a group of pixels of one image, between a group of 
pixels of said one image and a second group of pixels of another 
image in the data-signal ; 

generating interpolated results as a function of these 
10 motion vectors; 

estimating the reliability of each motion vector 
corresponding to a particular group of pixels; 

calculating weights as a function of the reliability of 
the motion vectors; and 
15 generating an interpolated luminous intensity of a group 

of pixels for an interpolated image by calculating, on the basis of 
these weights, a weighted average of the interpolated results, 
wherein the interpolated luminous intensity of a group of pixels is 
calculated according to: 

20 

I^^^x) = (Zm=l,..,M ix) * i^^\{ic)}) / Zm=l,..,M {W^(x)}, (A) 

wherein I^*^(jc) is the interpolated luminous intensity of the group 
of pixels of an interpolated image F^"*"^, wherein the location of the 
25 group of pixels in the image is defined by the integer two- 
dimensional vector X and where the real value A defines the place 
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of the interpolated image F*^* in the image sequence F^, 
n=l,2, . . . ,k,k+l, . . . wherein Sm=l,..,M {•} is a summation from 
1 to M over its argument {.} and where w^^{x) is a weight 
3 0 corresponding to the m^^ interpolation result i^^+^m^^) • 

i^^^ix ) = median/ (l\ round {ic - A * 5^ (Jc)} ) , 

)+ I^^'{ic ))/2) , (B) 

( I^^^ ( round {Jc + (1 - A) * (x)} ) } , 

35 

wherein median{ . } is a function which gives the median value of its 
input arguments and round { . } is a function which gives the nearest 
integer value to each component of its input argument, and wherein 

1^(5) is a luminous intensity of the group of pixels at location x 
40 of the image f'^ and wherein ^*(3c) is the m*^^ two-dimensional 

integer motion vector, which is normalized between two successive 
images, of the M motion vectors which correspond to the group of 

pixels at location x and wherein the weight w^^(3c) is a function 
of the reliability of the motion vector D^{x) . 

3. (Previously Presented) The method as claimed in claim 2, 
wherein the reliability of the motion vector D^{x) is a function of 
the difference between the luminous intensities I^(3c) and 
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I^"^^ ( jc +D*(jc) ) and wherein the reliability is also a function of the 
relative frequency of occurrence of D^(x) in the neighborhood of 
the location x in the image F^. 

4. (Previously Presented) The method as claimed in claim 1, 
wherein the generation of interpolated luminous intensities is only 
performed in those parts of the images of the data-signal where 
edges in the motion vector field of the images are located. 

5. (Previously Presented) A method of mot ion- compensated 
interpolation of a data- signal, said data- signal comprising 
successive images wherein each image comprises groups of pixels, 
the method comprising the steps of: 

generating motion vectors, each motion vector 
corresponding to a group of pixels of one image, between a group of 
pixels of said one image and a second group of pixels of another 
image in the data-signal; 

generating interpolated results as a function of these 
motion vectors; 

estimating the reliability of each motion vector 
corresponding to a particular group of pixels; 

calculating weights as a function of the reliability of 
the motion vectors; and 
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15 generating an interpolated luminous intensity of a group 

of pixels for an interpolated image by calculating, on the basis of 
these weights, a weighted average of the interpolated results, 
wherein the generation of interpolated luminous intensities is only 
performed in those parts of the images of the data-signal where 

20 edges in the motion vector field of the images are located, and 

wherein the method comprises a step of edge detection, wherein an 

edge in the motion vector field of image f'^ is detected if at least 
one of the inequalities (CI) and (C2) is satisfied: 

25 ||[D;(x-^],-[^;(x + ^].||>T, (CD 

(X - K)], - [D; (x + k)], II > T, (C2) 

where q is a pre -determined integer value and wherein ||.|| is a 
30 function which yields the absolute value of its input argument, [.]^ 

is a function which yields the p^^ component of its vector input 
argument, where T is a pre -determined fixed real value threshold 

and wherein ^ is a vector which is given with: 

35 K = (K,;K,y, (D) 

where and K2 are integer values. 
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6. (Previously Presented) A device for mot ion- compensated 
interpolation of a data-signal, said data-signal comprising 
successive images wherein each image comprises groups of pixels, 
the device comprising: 

5 means for generating motion vectors, each motion vector 

corresponding to a group of pixels of one image, between a group of 
pixels of said one image and a second group of pixels of another 
image in the data-signal; 

means for generating interpolated results as a function of 
10 these motion vectors; 

means for estimating the reliability of each motion vector 
corresponding to a particular group of pixels; 

means for calculating weights as a function of the 
reliability of the motion vectors; and 
15 means for generating interpolated luminous intensities of 

groups of pixels by calculating, on the basis of these weights, 
weighted averages of the interpolated results. 

7. (Previously Presented) A picture signal display apparatus, 
comprising: 

means for receiving a data- signal, which data- signal 
comprises successive images wherein each image comprises groups of 
5 pixels; 

PHNL010022 -BRIEF- 092 105 15 



a device for mot ion- compensated interpolation of said 
data-signal, as claimed in claim 6; 

means for generating at least one interpolated image on 
the basis of said interpolated luminous intensities; and 

means for displaying the at least one interpolated image. 
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(ix) Evidence Appendix 

There is no evidence which had been submitted under 37 CF.R. 
1.130, 1.131 or 1.132, or any other evidence entered by the 
Examiner and relied upon by Appellant in this Appeal. 

(x) Related Proceedings Appendix 

Since there were no proceedings identified in section (ii) 
herein, there are no decisions rendered by a court or the Board in 
any proceeding identified pursuant to paragraph (c) (1) (ii) of 37 
CF.R. 41.37. 
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